UNCLASSIFIED 


AH  297  954 


f^epAoduced 
^  ilte 


ARMED  SERVICES  TECHNICAL  INFORMATION  AGENCY 
ARLINGTON  HALL  STATION 
ARLINGTON  12,  VIRGINIA 


UNCLASSIFIED 


NOTICE:  When  government  or  other  drawings,  speci¬ 
fications  or  other  data  are  used  for  any  purpose 
other  than  in  connection  with  a  definitely  related 
government  procurement  operation,  the  U.  S. 
Government  thereby  incurs  no  responsibility,  nor  any 
obligation  \rtiatsoever;  and  the  fact  that  the  Govern¬ 
ment  may  have  formulated,  furnished,  or  in  any  way 
supplied  the  said  drawings,  specifications,  or  other 
data  is  not  to  be  regarded  by  implication  or  other¬ 
wise  as  in  any  manner  licensing  the  holder  or  any 
other  person  or  corporation,  or  conveying  any  ri^ts 
or  permission  to  manufacture,  use  or  sell  euay 
patented  invention  that  may  in  any  way  be  related 


thereto. 


I 


^  qVCEMORANDUM 
C:H!^te538-PR 

l^yRUARY  1963 
C--) 


INVARIANT  IMBEDDING 
AND  THE  INTEGRATION  OF 
HAMILTON’S  EQUATIONS 

Richard  Bellman  and  Robert  Kalaba 


A 

1  .  ‘ 


PREPARED  FOR: 

UNITED  STATES  AIR  FORCE  PROJECT  RAND 


MnD 


MEMORANDUM 

RM-3538-PR 

FEBRUARY  1963 


INVARIANT  IMBEDDING 
AND  THE  INTEGRATION  OF 
HAMILTON’S  EQUATIONS 

Richard  Bellman  and  Robert  Kalaba 


This  research  is  sponsored  hy  the  United  States  Air  Force  under  Project  RAND  — 
contract  No.  AF  49(638) -700  monitored  hy  the  Directorate  of  Development  Planning, 
Deputy  Chief  of  Staff,  Research  and  Development,  Hq  USAF.  Views  or  conclusions 
contained  in  this  Memorandum  should  not  he  interpreted  as  representing  the  official 
opinion  or  policy  of  the  United  States  Air  Force.  Permission  to  quote  from  or  repro¬ 
duce  portions  of  this  Memorandum  must  be  obtained  from  The  RAND  Corporation. 


lit 


MflD 


1700 


N  ST  •  SANTA  MONICA  •  CAIIFORNIA 


ill 


PREFACE 

Part  of  RAND'S  long-range  research  program  in  mathematical 
physics  has  been  devoted  to  obtaining  improved  computational 
techniques  for  determining  critical  mass  (a  contribution  to  neutron 
transport  theory),  and  to  developing  new  analytical  approaches  to 
transport  theory,  in  general.  This  work  has  led  to  new  analytical 
techniques  for  the  integration  of  the  basic  eq.uations  of  classical 
particle  dynamics,  providing  another  example  of  how  basic  research 
in  one  area  frequently  sheds  light  on  a  seemingly  unrelated  one. 

This  Memorsmdum  deals  with  theoretical  problems  amd  basic 
equations  in  analytical  dynamics.  It  should  be  of  interest  to 
those  concerned  with  orbit  determination,  trajectory  optimization. 


and  related  fields. 


SUMMARY 


Based  on  earlier  work  on  the  application  of  the  principle  of 
invariant  imbedding  to  problems  in  transport  theory,  the  authors 
describe  a  countercurrent  flow  model  which  can  be  associated  with 
any  mechanical  process  described  by  Hamilton's  equations  of  motion. 
Then  they  show  how  the  determination  of  certain  reflection  and  trans¬ 
mission  functions,  which  occur  natxirally  in  the  transport  process, 
leads  to  the  solution  of  Hamilton's  equations.  Some  exanqjles  aj:e 
given,  and  some  possible  future  applications  are  sketched. 
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I.  IICTRODUCTION 

Much  of  classical  analytical  cJynamics  is  concerned  vith  the 
integration  of  Hamilton's  canonical  equations  of  motion  [1,2],  The 
primary  general  approach  is  through  the  Hamilton-Jacobi  theory  [2,3], 
which  involves  determining  a  cocqjlete  solution  of  the  Hamilton-Jacobi 
eqmtion,  a  nonlinear  paxtial.  differential  equation  of  first  order. 
Our  aim  in  this  Memorandum  is  to  present  em  alternative  approach 
which  has  several  conceptual  and  manipulative  advantages  : 

1.  Only  functions  with  clear  physical  meanings  are  Introduced 
(no  "action  functions"  are  used). 

2.  The  functions  are  solutions  of  quasilinear,  as  opposed  to 
nonlinear,  first  order  partial  differential  equations. 

3.  The  functions  are  solutions  of  initial  value  problems  which 
facilitates  their  computational  solution. 

4.  The  methodology  is  eq'oally  vaLLld  for  equations  of  motion 
which  do  not  arise  from  variational  principles. 

In  earlier  work  we  discussed  the  application  of  principles  of 
invariance  to  the  analysis  of  transport  processes  [4,5].  There  it 
was  quite  natural  to  introduce  certain  transmission  and  reflection 
functions  eind  to  derive  equations  for* them  [6,7].  In  this  Memorem- 
dum  we  associate  a  countercurrent  flow  model  with  each  dynamical 
process  [8],  and  we  interpret  the  reflection  and  transmission  func¬ 
tions  in  mechanical  terms.  We  show  that  the  solution  of  the  canonical 
equations  of  motion  can  be  given  in  terms  of  these  reflection  and 
transmission  functions.  Some  examples  of  the  methodology  are  given 
involving  harmonic  oscillations  and  motion  in  uniform  and  central 
inverse-square  fields  of  force.  Some  possible  futiire  uses  are 
sketched . 
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Other  uses  of  functionsLl  equation  techniques  in  mechanics  are 


given  in  [9],  [lO]  and  [U], 
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II.  HAMILTON'S  EQUATIONS  AND  THE  COUMTERCURRENT  FLOW  MODEL 
OF  MECHANICAL  PROCESSES 

Let  us  consider  a  mechanical  system  with  N  degrees  of  freedom 
with  a  hamiltonian  H(q,p,t),  where  q  and  p  are  N-dimensional  vectors. 
The  canonical  equations  of  motion  are 

(1)  %  =  V 


(2) 


-  Pi 


H 


equations  which  are  to  hold  for 


(3)  0  s  t  s  T 
and 

(4)  i=l,2,.,.,N. 

Similar  equations  occurred  in  [6]  end  [?]•  With  these  equations 

"til 

we  associate  a  steaxiy  flow  in  a  tube  of  length  T.  The  i''  component 
of  the  vector  q(t),  q^(t),  represents  the  amount  of  material  of  the 
i  type  passing  the  point  t  per  unit  of  time  end  moving  toward  the 
right.  Similarly,  the  i  component  of  the  vector  p(t),  p^(t) 
represents  the  amount  of  material  of  the  i  type  passing  the  point 
t  per  unit  of  time  and  moving  toward  the  left.  Furthermore,  we  wish 
to  assiame  that  the  various  flows  interact  with  one  another  and  with 
the  medium.  The  exact  nature  of  the  interaction  in  a  section  of  the 
rod  extending  from  t  to  t  +  A  is  assumed  given  by  the  relations 


(5) 


q^(t  +  A) 


q  (t)  +  A  H  (q(t),  p(t), 

1  Pi 


t )  +  o(A ) 
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and 

(6)  P^(t)  =  p^(t  +  A)  +  A  (q(t),  p(t),  t)  +  o(A)  , 

i=l,2, ...,N  . 

Equations  (l)  and  (2)  represent  limiting  forms  of  these  equations 
obtained  by  letting  A  tend  to  zero.  Finally,  let  us  suppose  that 
there  is  a  steady-state  input  flow  to  the  right  at  t  =  0  given  by 

(7)  q.(0)  =  w.  ,  i=l,2,...,N 

and  a  steady-state  input  flow  to  the  left  at  t  =  T  given  bj* 

(8)  P.(T)  =  y^  ,  i  =  l,2,...,N  . 

The  countercurrent  flow  model  of  a  mechanical  process  is  shown 
diagramaticailly  in  Fig.  1. 


Fig.  1  --  The  Counter ciurrent  Flow  Model  of  a 


Mechanical  Process 
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III.  THE  REFIECTION  VECTOR  OR  THE 
TERMINAL  DISPIACEMENT  VECTOR 

Some  questions  now  arise  in  connection  with  the  physical 
situation  which  has  just  been  sketched: 

1.  What  are  the  internal  flows  that  are  produced  as  a  resxilt 
of  the  impressed  flows  at  the  ends  of  the  rod?  In  terms 
of  the  original  mechcuiiceil  process,  if  the  initial  displace 
ments  and  terminal  moments  are  given,  what  are  the  inter¬ 
vening  displacements  and  moments? 

2.  What  is  the  flow  to  the  right  at  the  right  end  of  the  tube 
and  the  imknown  flow  to  the  left  at  the  left  end  of  the 
rod?  In  terms  of  the  original  mechanical  process,  what 
are  the  unknown  moments  at  the  initial  instant  and  the 
unknown  displacements  at  the  termination  cf  the  process? 

We  shall  first  focus  our  attention  on  question  2  and  then  show 
how  the  answer  to  that  question  leads  us  to  the  answer  of  question  1 

The  unknown  flows  to  the  right  at  the  right  end  of  the  tube 
depend  upon  the  two  input  flows  w  and  y,  and  also  upon  the  length 
of  the  tube,  T.  Let  us  then  introduce  the  functions 

(l)  r(i,w,y,T)  =  the  amount  of  material  of  type  i  emerging  per 

unit  time  from  the  right  end  of  the  tube  ex¬ 
tending  from  0  to  T,  due  to  aui  input  flow  w  at 
the  left  end  of  the  tube  and  an  input  flow  y 
at  the  right  end  of  the  tube,  i  =  1,2,...,N. 


We  shall  derive  a  system  of  partial  differential  equations  for  these 
functions  by  relating  the  functions  r(i,w,y,T  +  A)  to  the  functions 
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r(i,w,y,T).  The  first  set  of  functions  refers  to  a  tube  extending 
from  0  to  T  +  A  and  the  second  to  one  from  0  to  T. 

To  terms  involving  the  first  power  in  A,  the  desired  relations 

are 


(2) 


N 

'(i,w,y,T  +  A)  =  H  (r,y,T)A  +  A  )  — H  (r,y,T)  , 

in=l 


+  r(i,w,y,T)  , 


i=l,2,...,N 


0 


T  T  +  A 


Fig.  2  The  Physical  Sitxmtion 


The  first  term  on  the  right  hand  side  of  Eq.  (2)  arises  from 
the  interaction  of  the  fluxes  y  and  r(i,w,y,T)  in  the  interved.  T  to 
T  +  A.  The  second  arises  from  the  reflection  of  particles  from  the 
tube  extending  from  0  to  T  due  to  particles  incident  at  t  =  T, 
modified  by  a  passage  through  the  section  of  tube  extending  from 
T  to  T  +  A, 

Upon  letting  A  tend  to  zero  ’3q..  (2)  becomes 


(3)  ■  H 


N 


(r,y,T)  +  ^ 


m=l 


m  m 


i=l,2,. 


•  > 


N. 
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This  is  the  desired  quasilineer  system  of  ijartial  differential 
equations  for  the  unknovn  displacements  in  terms  of  the  initial 
displacement  vector  v,  the  duration  of  the  process  T  and  the  ter¬ 
minal  momentum  vector  y.  This  is  merely  a  reinterpretation  of 
equations  given  in  [6]  and  [7]  for  the  flow  problems. 
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IV.  the  transmission  vector  or  the  initial  MCmNI'UM  VECTOR 


Let  us  introduce  the  transmission  functions 


(l)  T(i,w,y,T)  =  the  amoxmt  of  material  of  type  i  emerging  from 

the  left  end  of  the  tube  extending  from  0  to  T 
due  to  eui  input  flow  v  at  the  left  end  of  the 
tube  and  an  input  flow  of  y  at  the  right  end 
of  the  tube,  i  =  1,2, ...,N 


Then,  as  is  indicated  in  [6]  and  proved  in  [7],  the  functions 
T(i,w,y,T)  satisfy  the  system  of  equations 


N 


Notice  that  the  Bqs.  (3*3)  and  (2)  form  a  system  of  quasilineea* 
first-order  partial  diffeirential  equations  with  the  same  principle 
parts.  These  are  discussed  in  [3>  pp.  139-1^5] • 
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V.  INTEGRATION  OF  HAMILTON'S  BftUATIONS  USIMG  THE  r  AMD  t  FUNCTIONS 

Let  IIS  begin  by  noting  that  the  reflection  and  transmission 
vectors  are  easily  determined  for  tubes  of  zero  length.  We  have 


(1) 

r(i,v,y,0)  =  w^ 

and 

(2) 

T(i,w,y,0)  =  y^  , 

i=l,2,...,N  . 

Suppose  next  that  we  can  solve  the  systems  of  quasilinear  partial 
differential  Bqs .  (3-3)  and  (4.2),  subject  to  the  conditions  given 
above .  Then  we  see  that  we  obtain  the  Integrals  of  the  cemoniceLL 
Eqs.  of  motion  (2.1)  and  (2.2)  in  the  form 


(3) 

=  r(i,w,p(t),t) 

(M 

b. 

1 

=  T(i,w,p(t),t)  , 

i=l,2, . . . ,N  . 

There  are 

constants 

2W  arbitrary  constants,  and  b^,  i  =  1,2,...,N.  The 

b^  represent  the  flows  to  the  left  at  t  =  0  due  to  input 

flows  of  w  and  p(t)  at  t  =  0  and  t  =  t,  respectively,  to  a  tube  ex¬ 
tending  fron  0  to  t. 

It  is  easy  to  verify  directly  that  ^  r(i,v,y,T)  and  T(i,v,y,T) 
satisfy  the  quasilinear  partial  differential  Eqs.  (3-3)  and  (4.2) 
respectively,  and  if  the  functions  q^(t)  and  p^(t)  satisfy  Eqs.  (3) 
and  (4),  then  the  functions  q^(t)  euid  p^(t)  are  solutions  of  Hamilton's 


equations . 


First  differentiate  the  equations  in  (4)  with  respect  to  t  to 
obtain 


i=l,2, . . . ,N  . 


In  addition,  if  we  differentiate  Eq.  (3)  with  respect  to  t  and  use 
Eqs.  (7)  and  (3.3 we  obtain  the  relations 


But  Eqs.  (7)  and  (8)  are  the  desired  canonical  equations. 
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VI.  EXAMPIES 

We  now  turn  to  some  Illustrations.  Let  us  first  consider  the 
harmonic  oscillator  for  vhich 


(1) 


H(q,p,t)  =  +  I  k  q'" 


The  canonical  equations  of  motion  are 


(2) 

and 

(3) 


q  =  p/ 


m 


-  p  =  k  q 


q(o)  =  V  ^ 


p(T)  =  y  , 


where  q  and  p  are  now  scalar  qxiantities.  Equation  (3.3)  becomes 


(^) 

with 

(5) 


dr 


5^  +  kr 

m 


dr 


r(v,y,0) 


V  . 


Equation  (^.2)  becomes 
(6)  =  k  r 


dj 

¥ 


with 

(7)  T(w,y,0)  =  y  . 


For  simplicity  consider  those  processes  for  which 
(8)  w  =  0  , 

i.e.,  processes  for  which  the  initial  displacement  is  zero.  Then 
the  linearity  of  Eqs.  (2)  and  (3)  suggests  writing  the  fxmction  r 
in  the  form 
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(9)  r  =  R(T)y  . 

Substitution  of  this  in  Eq.  (4)  yields  an  ordinary  differential 
equation  of  Rlccati  type  for  tte  function  R(T) 

(10)  ^  =  w  =  0  . 

The  solution  of  this  equation  is 

H 

(n)  R(T)  =  —  tan 


so  that 

(12) 


In  addition,  the  solution  of  Eqs.  (6)  and  (7)  is 
(13)  T  =  y  sec  \f^  T  . 
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Next  let  us  consider  motion  of  a  i>article  of  mass  m  in  a  uniform 
field  of  force.  We  choose  rectangular  coordinates  x  =  and  y  = 
so  that  the  potential  energy  is  given  by  the  formula 


(18) 

U(x,y)  =  m  g  y 

We  denote  the  x 

and  y 

components  of  momenta  by  p^ 

hamiltonieui  is 

(19) 

H  = 

1  2  ^  2  > 

S  C  Px  ^  Py  J  ^  “  e  y  > 

and  the  canonical  equations  of  motion  eu:« 

(20) 

• 

X  = 

o 

II 

1 

(21) 

« 

y  = 

Py/m  ,  -  Py  =  n  e  . 

The  partial  differentieil  equations  for  the  reflection  functions 
become 

(22) 

and 

(23) 

The  solutions  of  these  equations,  subject  to  the  conditions  (5*l)> 


^1 

"3t  = 

=  —  + 
m 

o 

*  ^ 

^2 

“5t  = 

m 

- 

are 

(24) 

H 

II 

T  +  w 

(25) 

^2 

^2  m 

T  +  ^  g  T^  +  Wg  . 

The  equatioriB  for  the  transmission  functions  are 


(26) 

II 

dT 

and 

(27) 

II 

8t2 

The  solutions,  subject  to 

the  conditions  (5.2),  are 

(28) 

”^1  = 

^1 

(29) 

^2  = 

y^  +  n  g  T  . 

Then  Eqs 

.  (24)  and  (25)  lead  to  the  integrals 

(30) 

x(t) 

■  »  '  *  ”1 

(31) 

y(t) 

Py(t)  1  2 

"  t  +  2  g  t  +  W^  , 

and  Bqs . 

(28)  and  (29)  lead  to  the  integrals 

(32) 

\  = 

p^(t) 

(33) 

^2  = 

Py(t)  +  m  c  t  . 

But  Bqs . 

(30)  -  (33)  are  a 

form  of  the  solution  of  the  canonical 

Bqs .  (20)  and  (21),  where  and  b^  are  the  initial  momenta  and  w 
and  w^  are  the  initial  displacements . 


Finally,  to  show  the  effect  of  kinosthenic  coordinates, 
we  derive  the  law  of  the  constancy  of  angular  momentum  for  the 
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notion  of  a  particle  in  aji  inverse -square  central- force  field. 
Using  polar  coordinates  euid  an  obvious  notation,  we  see  that  the 
hami Itonian  is 


i3h) 


H  = 


2^ 

2m 


( 


-2 


)-? 


Hamilton's  equations  become 


(35) 


(36) 


- 


0  . 


Upon  letting  the  subscript  "l"  refer  to  the  rsuiial  components  and 
the  subscript  "2"  refer  to  the  angtilar  components,  we  find  that  the 
partial  differential  equations  for  the  reflection  emd  transmission 
functions  are 


l6 


Eqviation  (4o),  coiq>led  with  the  condition  of  Bi.  (5*2)  has  the 
solution 

(^1)  Tg  =  yg 

Our  integration  principle  tells  us  that  during  the  process 
(42)  Pg  =  const.  , 

which  is  the  desired  result. 
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VII.  DISCUSSION 

The  advantages  in  providing  sonie  alternate  mathematical  formula¬ 
tions  of  physical  processes  are  many.  In  the  first  place,  some 
formulations  are  analytically  more  tractable  than  others  for  par¬ 
ticular  processes,  and  often  the  successful  numerical  solution  is 
wholly  dependent  upon  choosing  the  appropriate  formulation. 

Perhaps  even  more  important  are  the  concepttial  advantages.  If 
we  can  visualize  various  functions  as  reflected  or  transmitted  fluxes, 
or  velocities,  or  moments,  we  intuitively  gain  a  stronger  hold  on 
the  physical  process  and  on  the  equations  describing  the  process. 

Too  much  of  previoias  analysis  has  been  inflexible,  wedded  to  a 
particular  analytical  formulation.  In  forthcoming  Memoranda  we  shall 
discuss  some  other  classes  of  problems  in  versatile  terms. 
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